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Al^STltACT 

This  paper  investigates  aspects  of  obtaining  a concensus  ranking 
from  ordinal  rankings  supplied  by  committee  members.  A procedure  for 
calculating  the  distance  between  rankings  which  are  represented  by  vectors 
is  given  along  with  an  algorithm  for  deriving  a min-max  concensus  ranking. 
In  addition,  an  approach  to  the  committee  ranking  problem  which  makes 
allowance  for  weights,  partial  rankings  and  multiple  attributes  is 


discussed. 


I 


Introduction 

In  [5]  Kemeny  and  Snell  define  the  median  of  a set  of  m rankings 


}.  , of  n objects  to  be  that  ranking  B for  which 

%r-l 


m 


I d(A^,B)=  I I \a\.-h.\ 
I ij 


(1.1) 


1=1 


I I 

Is  minimized.  (a..)  is  the  matrix  representation  of  the  ranking  A ; 
1-J 


l.e.,  a.  . = +1  if  i is  preferred  to  j,  -1  if  j is  preferred  to  i 
‘^3 


and  0 if  i and  j are  tied  in  preference.  The  determination  of  B 

.a 


is  Important  in  cases  where  the  A aire  rankings  provided  by  members 
of  a committee,  in  that  it  represents  one  form  of  compromise  or 
concensus.  Cook  and  Salpe  [4]  describe  a branch  and  bound  algorithm 
for  solving  this  problem.  Some  computational  results  relating  to  this 
algorithm  are  given  in  [3],  [8]  and  [9]. 

In  this  article  we  Investigate  some  further  aspects  of  the  con- 
census problem  in  committee  ranking.  In  section  3,  we  consider  the 
I norm  rather  than  the  I norm  of  (1.1).  In  this  case  we  minimize 
the  maximum  of  the  deviations  rather  than  minimizing  the  total 
deviation.  Since  computer  storage  is  a problem  if  the  above  matrix 
representation  of  rankings  is  preserved,  we  give  an  alternate 
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I I' 


> „ 
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representation.  A formula  for  computing  distances  under  this  revised 
representation  is  derived  in  section  2.  This  will  then  be  used  to 
compute  bounds  in  the  algorithm  which  follows.  An  illustrative  example 
Is  given  along  with  a brief  discussion  of  the  computational  aspects. 

Section  4 presents  a more  general  approach  to  the  committee 
rahklng  problem.  We  investigate  partial  rankings  in  connection  with 
the  concept  of  a median  and  discuss  its  derivation.  In  addition, 
weighted  rankings  are  examined.  We  conclude  with  a brief  discussion  of 
weight  assignment. 

2.  Computational  Procedure  for  Calculating  d(A,B) 

;;; 

Kemeny  and  Snell  [5]  define  the  distance  between  two  rankings  A 
0 

and  A to  be 


0 1 n n 

d(A^,A^)  = f I I 


i=l  j=l 


I i k 

\a.  .-a.  . 


(2.1) 


Clearly,  the  computations  involved  in  calculating  this  distance  is 

I k 

straightforward  when  A and  A are  available  explicitly.  However,  if 
there  are  several  committee  members  and  a ranking  matrix  is  saved  for 
each  member,  a large  amount  of  computer  storage  would  be  consumed. 

a 

Because  the  ranking  matrices  are  skew  symmetric,  the  amount  of 
i\ecessary  storage  can  be  substantially  reduced  by  saving  only  the  elements 
above  the  diagonal.  Additionally,  because  all  the  elements  of  the 
ranking  matrices  are  0,  -I  or  -fj,  the  data  could  be  packed  in  the 
computer.  The  latter  technique  would  cause  the  computer  code  to  be 
machine  dependent,  however,  while  the  former  would  still  require 


■d 
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nfn-D/Z  storage  locations  for  each  committee  member.  These  drawbacks 
can  be  overcome  by  saving  the  ranking  matrices  on  peripheral  storage 
devices,  but  if  it  is  necessary  to  access  the  rankings  frequently  this 
approach  can  be  expensive  and  time  consuming.  In  this  section  we 

present  an  alternative  method  for  saving  committee  member  rankings 

% 

and  calculating  distance. 

Two  vector  representations  of  the  committee  member's  ranking 
of  n objects  are  given  by  the  following: 


IJ 


where  q.  ^ i Implies  that  committee  member  I ranks  object  j In  the 
J 

t*’*'  position.  Ties  are  indicated  by  assigning  the  (same)  average 
ranking  to  tied  objects.  For  example,  a ranking 


((2,2)  Is  the  notation  used  by  Kemeny  and  Snell  and  Is  unsuitable  for 
digital  computers)  is  given  by 


T 


(8.b,  6.5,  6.5,  5,  2,  2,  4,  8.5,  2). 


The  second  vector  representation  is: 
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r = (r  (1),  r (2),  r*  (n) ) 

1 . . 

where  r (i)  = j implies  that  committee  membei  2.  ranks  object  j in  the 

position,  r (i)  = -j  Indicates  that  the  committee  member  is 

2 

indifferent  between  object  j and  object  r (i+1) . For  the  previous 
ranking 

/ = r-5,  -5,  9,  7,  4,  -2,  2,  -1,  8) 

These  two  vector  representations  are,  of  course,  redundant  as  all 

the  necessary  information  concerning  a ranking  can  be  obtained  from 

either  one.  However,  even  if  both  representations  are  saved  the  storage 

requirements  are  considerably  less  than  for  the  matrix  representation. 

2 k 

It  will  now  be  shown  how  d(A  ,A  ) can  be  calculated  efficiently 

using  q and  r.  Through  the  remainder  of  the  section  the  superscripts 

on  q and  r will  be  oMtted.  It  will  be  assumed  that  q always  has  a 

superscript  2 and  that  r always  has  a superscript  k.  Also,  since  r is 

a column  vector,  when  object  j is  below  object  i it  is  meant  that  when 

looking  down  r t is  encountered  before  j.  Hence,  in  the  previous 

example,  9 is  above  7 but  below  6. 

Before  we  state  and  prove  a theorem  which  will  be  Instrumental  in 

k 2 

developing  the  procedure  to  calculate  d(A  ,A  J,  the  following  definitions 
are  needed. 


The  number  of  objects  tied  with  r(j)  and  below 
J)  r(j)  in  the  ?cth  committee  member's  ranking, 

r(j)  and  also  tied  with  r(j)  in  the  2^^  committee 

member's  ranking. 


5 


K(j) 

The  number  of  objects  tied  with  r(j)  and  below 
r(j)  in  the  fcth  committee  member’s  ranking, 
and  T'[j)  preferred  to  them  in  the  2,th  committee 
member's  ranking. 

^r(j) 

The  number  of  objects  tied  with  r(j)  and  below 
i>(j)  in  the  committee  member's  ranking,  and 

preferred  to  j’(j)  in  the  £,th  committee  member's 
ranking. 

^r(j) 

The  number  of  objects  above  p(j)  in  the 
committee  member's  ranking  and  tied  with  r(j) 
in  the  committee  member's  ranking. 

^r(j) 

The  number  of  objects  above  r(j)  in  the 
committee  member's  ranking  and  rf'j)  preferred 
to  them  in  the  committee  member's  ranking: 

k ^ 

Theorem  2.1:  The  distance  between  >1  and  A as  defined  by  (2.1)  is 

given  by; 


I (2H  + T ...  + ~ T~  ...  - 

1=7 


(2.3) 


Proof ; It  will  be  proven,  by  induction  that 

M 


^ ^r(J)  * K(j)  ■ ^r(j)  ' 


2 . I ^ 

^ ih 


(2.4) 


where  is  a summation  over  the  rows  and  columns 

ij 

r(l)f  r(2),  ...j  rCi),  and  M in.  Then  since 


n n 


I 

J=2 


r(,V 


I 

J=2 


J. 


the  proof  of  the  theorem  follows: 


( 


c 


Assume  that  (2.4)  is  true  for  M = m-1  (the  proof  for 
M = 1 is  very  similar  to  the  one  about  to  be  given  for 
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M = m and  is  omitted).  Then  to  prove  (2.3)  is  true  for 
M = m it  must  be  shown  that  the  inclusion  of  column  and 
and  row  r(m)  increases  the  summation  of  the  right  hand 
side  by 


2B 


r(m)  ^ 


+ T 


rim) 


- T 


r(m) 


- f 


r(m) 


Note  that  all  the  rows  and  columns  corresponding  to  objects 
above  r(m)  have  already  been  included  in  the  summation  with 
M = m-1. 


Let  B be  the  number  of  objects  tied  with  in  the 

6 

committee  member's  ranking.  There  arl  o , , - - 2 

r(mj  z 

objects  preferred  to  r'(m)  in  the  committee  member's 

ranking.  Of  these,  the  rows  and  columns  corresponding  to 

* 

(m-1)  - H - T ot  them  have  already  been  Included 
r(m)  r(m) 

in  the  summation  with  M = m - 1,  By  including  row  and 
column  r(m)  in  summation  (2.4),  non-zero  quantities  that 
were  not  present  before  will  be  added  in  the  following 
cases : 


CASE 


TOTAL  CONTRIBUTION 


i.  The  case  where  r(m)  is  preferred 
to  certain  objects  in  committee 
member  fe's  ranking  and  the 
reverse  is  true  in  committee 
member  L's  ranking. 


-f  - 


^ ^ (m;  (m; rm; 
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CASE 

2.  The  case  where  objects  are  tied 
with  rCm)  and  below  r'(m)  in 
committee  tnembt  r k' s ranking  but 
not  tied  with  r(m)  in  committee 
member  £'s  ranking. 

3.  The  case  where  r(rr)  is  preferred 
to  certain  objects  in  committee 

^ member  k' s ranking  and  is  tied  with 
r(m)  in  committee  member  £'s  ranking. 


TOTAL  CONTRIBUTION 


^r(m)  * ^r(n) 


T 

p(m) 


Therefore,  the  summation  on  the  right  hand  side  of  (2.4) 
Increases  by 


2B  . , + T , , -f-  T , X - T , - T , , + 2 (q  , ,-fu) 

r(m)  r(m)  r(m)  r(m)  r(mj  ^r(m) 

and  this  proves  the  validity  of  (2.4).  The  proof  of  the 
theorem  now  follows  by  letting  M = n and  observing  that 


□ 


n 


I 4 


r(j) 


n 


I 


0- 


Although  the  method  of  calculating  distance  given  in  the  theorem 
appears  much  more  cumbersome  chan  the  direct  application  of  (2.1),  the 
structure  of  (2.3)  makes  the  implementation  in  a computer  code  quite 
efficient.  It  is  not  felt  that  s detailed  discussion  of  such  a code 
is  appropriate  here,  but  a copy  of  a FORTRAN  version  of  a code  designed 
to  calculate  distance  via  (2.3)  can  be  obtained  upon  request  from  the 
authors.  An  advantage  of  (2.3)  is  the  previously  mentioned  reduction 
in  storage  requirements.  Also,  the  rankings  will  generally  be  supplied 
in  a form  such  as  <7  or  r and  (2.3)  will  not  require  the  construction  of 


8 


the  ranking  matrix. 

We  conclude  this  section  with  an  example  calculating  the  distance 
between  two  rankings  by  using  (2.3). 

Let 


= (-5,  -6,  9,  7,  4,  -Z,  2,  -1,  8) 

% 

and 

= (3,  2.5^  1.5,  8.5,  5.5,  4,  7,  8.5,  5.5) 


The  first  ranking  is  the  previous  one  and  the  second  ranking  is 


1 


j = 2^  r(2)  = -5,  = 5.5,  = 0,  = 2,  = 0 

J = 2,  r(2)  = -6,  q^  = ^’5  = 0,  = 1 , T~^  = 0,  = 0 

Q = Z,  r(Z)  = 9,  q^=  5.5,  = 0,  = 0,  T~  ^ 0,  = 2 


J 
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* 0 * - 

j = 4,  r(4)  = 7,  q^=  7 = 0 
i « 5,  r(S)  = 4,  = 8.S,  = T~^  = t]  = = 0 

j = 6,  r(6)  = -3,  q^  = l.S,  = 2,  = T~  = T*  = 0,  = 6 

3 = 7,  r(7)  = 2,  q^  = 1.5,  = T~  = 0,  T*^  = 1,  = 5 

3 = 8,  r(8)  = 1,  q^=  3,  T°  = 0 , t\  = 1,  T~^  = t\  = Q,  = 5 
3 = 9,  r(9)  = 8,  q^=  8.5,  = tJ  = T"  = 0,  T*  = 1,  H^=  0. 


By  performing  the  summation  of  (2.3),  the  distance  between  the 
two  rankings  is  found  to  be  34. 

3-  The  L Norm  Ceneensua  Ranking 

This  itctior.  will  develop  a branch  and  bound  (7)  algorithm  to 
obtain  an  L norm  or  mln-max  consensus  ranking  for  m rankings  of  n 
objects.  This  type  of  consensus  ranking  minimizes  Che  maximum  distance 
between  Itsalf  and  any  ranking  supplied  by  a committee  member.  The 
algorithm  to  be  described  here  will  consider  only  complete  rankings 
(see  [7])  as  candidates  for  the  consensus  ranking.  The  modifications 
tb  allow  tias  In  the  consensus  ranking  are  obvious  but  will  generally 
increase  the  size  of  the  solution  tree  exponentially.  Ue  denote  Che 
mln-max  consensus  ranking  by  the  matrix  b and  let  d*  *■  rnax  (A^,B)‘ 

Let 

= d(A^,A^),  k = 1,  2,  ...,  m-1 
I = i+1,  . . . , m 
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The  algorithm  begins  by  calculating  the  distance  between  every  pair  of 
rankings  supplied  by  the  committee  members.  A lower  bound  on  d*  is  then 
given  by 


LB 


<d*  /2> 


(3.1) 


where 

t 

J^o  J<1 

d*  = max  d 

kA 

and  <K>  is  the  smallest  integer  greater  than  or  equal  to  X- 

I k 

A candidate  consensus  ranking  is  obtained  by  summing  q ^ and  q ^ 

(the  two  rankings  yielding  d*  )«  and  inspecting  the  magnitude  of  the 
components  in  the  resulting  vector.  The  object  with  the  smallest  entry 
will  be  most  preferred  in  the  candidate  consensus  ranking;  the  object 
with  the  next  smallest  entry  will  be  ranked  second  and  so  on.  Since 
we  are  only  allowing  complete  iTanking,  ties  are  not  allowed,  and  they 
will  be  broken  in  an  arbitrary  manner.  The  candidate  ranking  obtained 
by  this  process  is  denoted  by  F.  A similar  procedure  for  obtaining  a 
conaenaua  ranking  la  given  by  Kendall  [6].  Ha  auma  all  m q'»  before 
ordering  and  shows  that  the  resulting  ranking  is  a least  squares 
consensus  ranking  when  "distance"  is  defined  differently  (see  [6],  p.ll4). 
The  r that  we  have  obtained  should  be  a good  estimate  of  B because  the 
min-max  ranking  represents  a compromise  between  the  most  widely  divergent 
committee  members. 

The  next  step  in  the  algorithm  is  to  calculate  the  distance  between 
r and  2,  We  define 


■a 
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UB  = max  (KV^A^),  k = Ij  2,  m. 


(3.2) 


If  UB  = LB,  then  the  algorithm  terminates  with  B = Otherwise,  a 
branch  and  bound  procedure  is  undertaken  to  obtain  £. 

The  dichotomy  performed  at  any  stage  of  the  tree  search  will  be  of 


the  form 


^ > J or  J > V, 


where  ">"  Is  read  as  "preferred  to."  A pictorial  view  of  three  nodes 
in  a tree  is  given  by  figure  1.  At  each  node  a lower  bound  and  a 
candidate  consensus  ranking  (which  in  turn  gives  an  upper  bound)  will 
be  obtained  by  a procedure  to  be  described  shortly.  When  the  lower 
bound  at  a node  is  greater  than  the  least  upper  bound  on  d*  that  node  is 
fathomed,  meaning  no  more  nodes  will  be  created  from  it.  The  algorithm 
terminates  when  all  nodes  have  been  fathomed  and  B Is  given  by  the 
candidate  consensus  ranking  yielding  the  least  upper  bound. 

Let  P be  the  total  number  of  live  nodes  (l.e.,  nodes  that  are  not 

fathomed  and  have  no  branches  emanating  from  them)  at  any  stage  in  the 

branch  and  bound  process.  Let  LB^  and  p 1,  2,  P be, 

respectively,  the  lower  bound  and  candidate  consensus  ranking  at  node  p. 

From  F cha  upper  bound  at  node  UB  , is  calculated  from 
« 

UB  = max  d(F  ,A^) 

P ^ P 

and  the  least  upper  bound  on  d*  is 


UB  = min  {UB  }. 

P 

P 


■d 


12 


I 


A picture  of  three  nodes  from  a possible  branch  and 
bound  tree.  At  node  p + 2 object  j must  be  preferred 
to  object  i in  any  candidate  consensus  ranking  and  at 
node  p + 2 the  reverse  must  be  true. 


-4 
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It  will  now  be  shown  how  f is  obtained.  Let  C be  a complete 

P 

ra:i<lng  which  will  be  manipulated  through  pairwise  interchanges  to 

obtain  r . Before  the  Interchanges  are  attempted  C = T where  3 
P 6 

the  irmediate  predecessor  of  node  p or,  for  p = 1,  C = T.  If  C 
satisfies  the  constraints  placed  on  the  ranking  at  that  particular  node 
w^  place  r = C and  calculate  Otherwise,  the  interchanges  necessary 

to  Slake  C feasible  are  performed.  Notice  that  because  of  the  transitive 
relationship  between  objects  the  constraint  just  imposed  on  the  ranking 
may,  in  conjucture  with  preceedlng  constraints,  create  other  constraints. 

Once  C is  feasible  painrise  adjacent  (we  assume  C is  represented 
In  the  form  given  by  r)  Interchanges  are  attempted  to  improve  C while 
maintaining  feasibility.  To  determine  when  an  Improvement  is  possible 
we  first  calculate  and  record 

d(C^A^),  ^ = J,  2,  n. 

kn  k 

Let  d(C^A^)’=  max  d(C,A  ),  To  improve  the  min-max  distance  between  C 
and  tha  ^ changes  in  the  ranking  given  by  C must  make  it  closer  to  the 
k^(h  conaiittee  member's  ranking.  Every  pairwise  adjacent  change  such 
ae  this  will  decrease  d(C,/l^/'by  two  or  one.  To  see  if  an  overall 
improvement  has  been  made,  all  d(C,/^)  within  two  of  d(C,^)  ere  checked 
to  see  whet  an  effect  such  a change  will  make  on  these  distances.  If 

■L 

none  of  them  would  increase  to  dfC^A  ^ the  Interchange  is  made,  all 
distances  are  updated  and  a new  determined  if  necessary.  The  process 
is  repeated  until  no  improvement  is  possible  and  then  is  placed 
equal  to  C.  Notice  that  has  already  been  calculated  while  determining 

r . 

P 


.14 


The  calculation  of  LB^  involves  determining  penalties  for  the 
restrictions  placed  on  and  adding  them  to  the  The  initial 

lover  bound  of  (3.1)  was  obtained  from  the  following  axiom  given  by 
Kemeny  and  Snell  [5,  p.9] 


d(A^^B)  + d(A^^B)  t d(^,A^). 


(3.3) 


Intuitively,  (3.3)  says  that  the  best  B can  do  is  to  split  the  difference 
between  and  . As  additional  restrictions  are  placed  on  the 

structure  of  S a positive  quantity  may  be  added  to  original  lover  bound. 

■k  Z 

To'  obtain  this  penalty  we  define  to  be  the  weighted  total  number  of 

conflicts  common  to  A^  and  A^  which  are  forced  by  the  restrictions  at 
node  p.  A weight  of  one  is  given  when  a conflict  involves  a tie  and 
weight  of  two  otherwise.  A lower  bound  is  obtained  from  the  following 
theorem. 


□ Theorem  3.1;  A lower  bound  on  the  distance  between  any  ranking  which 

P 

satisfies  the  restrictions  at  node  p and  the  A furthest 
from  that  ranking  is  given  by 


LB  m max  + <d^^/2>. 


(3.4) 


Proof  1 


The  distance  d^^  is  the  weighted  sum  of  the  conflicts 
between  and  A^  where  a weight  of  one  is  given  to  a 


conflict  involving  a tie  and  a weight  of  two  otherwise. 
The  best  we  can  hope  to  do  with  these  conflicts  in  the 
mln-max  sense  is  to  split  them.  Any  additional  conflicts 


enforced  by  the  restrictions  which  are  common  to  both 
k Z 

A and  A must  be  added  because  all  original  conflicts 


are  still  present. 


Thus,  by  taking  the  maximum  of 


^ V-  <d^^/2>  over  all  k and  Z LB  is  obtained. 
P P 

This  completes  the  proof. 


We  will  summarize  with  a step  by  step  statement  of  the  algorithm 
which  will  describe  possible  criteria  for  constructing  the  branch  and 
bound  tree. 


M 


STEP  1 : Calculate  for  1 ^ k < I ^ n and  determine  d*  equal  to 

the  minimum  d . Sum  q and  q and  derive  the  ranking  F in  the  manner 

previously  described.  Calculate  LB  from  (3.1)  and  UB  from  (3.2). 

If  LB  » t/B,  go  to  step  7.  Otherwise,  set  C = Ty  p = 1 and  go  to  step  2. 

STEP  2 ; Attempt  to  improve  C through  pairwise  adjacent  interchanges, 

updating  C and  UB^  when  improvements  are  made.  After  it  is  determined 

that  no  improvement  is  possible  from  pairwise  adjacent  Interchanges,  set 

r ■ C,  If  UB  < UB,  set  UB  =.UB  and  save  F as  the  best  complete 
P P P P 

ranking  found  so  far.  Go  to  step  3. 

STEP  3;  Search  over  all  live  nodes  to  find  the  one  with  the  least 

lower  bound.  If  no  live  nodes  exist,  go  to  step  7.  Otherwise,  denote 

the  node  with  the  least  lower  bound  by  node  s.  Go  to  step  4. 

STEP  4;  Choose  the  two  objects  furthest  from  one  another  in  and 

whose  relationship  is  not  already  constrained.  Let  these  two  objects  be 

given  by  Y and  Z with  Y preferred  to  Z In  F . Create  two  new  nodes  from  e 

s 

by  restricting  T > Z at  node  p + 7 and  Z > T at  node  p + 2.  Check  over 
the  previous  restrictions  to  see  If,  in  conjunction  with  either 
y > Z or  Z > y,  any  additional  restrictions  are  automatically  imposed 
from  the  transitive  relationship  of  the  ranking.  If  any  restrictions 
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are  forced,  add  them  to  the  list  of  restrictions  at  the  appropriate 
node.  Go  to  step  3. 

STEP  5:  Calculate  for  1 i k < I ^ n and  determine  LB  , from  (3.4), 

p+1  p+1 

If  L5  - > UB,  fathom  node  p + 1.  Otherwise,  set  F = F and  go  to 
p+1  ^ ps 

step  6. 

SXiP  6:  Calculate  for  1 s < £■  s n and  determine  LB  „ from  (3.3), 

p+2  p+2 

If  ^^p+2  ^ fathom  node  p + 2.  Otherwise,  set  C = F^  and  force 
feasibility  by  interchanging  the  rankings  of  objects.  Calculate 
d(C,^  ),k  = J,  2y  ...j  n.  Set  p = p + 2 and  go  to  step  2. 

STEP  7 : An  optimal  min-max  consensus  ranking  has  been  obtained.  The 

ranking  yielding  UB  is  the  optimal  ranking  B and  d*  = UB. 


Example : To  demonstrate  the  algorithm  we  will  solve  a sample  problem 

with  three  committee  members  and  five  objects.  The  ranking  are  as  follows: 

<J  " (ly  2j  2y  4,  S),  q » Cl.S,  3j  S,  l.S,  4),  q * (4,  2,  2,  2,  S) 

r = (ly  2y  3y  4y  S)y  ^ = (~ly  4y  2y  Sy  S)y  = (-2y  ~3y  4y  ly  5) 


By  calculating  from  (2.3), 


*^12  ~ ^ ‘ ‘^13  ^ 

2 3 

Committee  members  2 and  3 are  furthest  apart,  so  q and  q are  summed 
to  obtain  (6.5,  5,  P,  5.6,  9).  The  ranking  F is  then  given  by 
{4y2yly3yS),  wh e t e this  representation  is  defined  as  r. 


LB  = 5 and  ^ 8 


dfVyA^  = By  d(TyA^)  = 5 
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and  d(T ,A  ) = 5. 

C is  placed  equal  to  F,  and  by  attempting  pairvise  adjacent 
interchanges  it  is  seen  that  C can  be  improved  by  Interchanging  objects 
4 and  2.  Ue  then  have 


UB  = UBj  = 7 and  F^  = (2,  4,  2,  3,  5). 


The  first  dichotomy  is  2 > 5 or  5 > 2.  Corresponding  to  the  constraint 

S > 2,  = 2 because  S > 2 is  in  conflict  with  the  rankings  of 

committee  member's  2 and  3.  Thus,  the  lower  bound  on  any  ranking  with 
5>2is5  + 2 = /’*  But  UB  = 7,  hence,  rankings  with  S > 2 need  not 

be  considered.  Although  it  was  not  stated  explicitly  in  the  algorithm,  it 

is  clear  that  a branch  with  the  constraint  5 > 2 is  not  required  and 
the  constraint  2 > 5 can  be  imposed  at  node  2.  Similarly,  the  algorithm 
will  impose  the  restrictions  2 > 3 and  4 > 3 at  node  2. 

The  next  dichotomy  to  be  considered  is  4 > 3 or  3 > 4.  The  latter 
restrictions,  along  with  those  already  present,  require  3 > 6 and  2 > 4. 

Nodes  2 and  3 are  now  created.  The  constraints  at  node  2 are  2 > S, 

2 > 3,  4 > 6 and  4 > 3.  The  constraints  at  node  3 are  2 > S,  2 > 3, 

4 > S,  3 > 4,  3 > 6 and  2 > 4. 


and 


0 


UB^  = 2 + S = 6. 


0, 


2 


and  UB^  =» 


7.  Thus,  node  Z is  fathomed. 
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The  algorithm  next  considers  node  2 for  further  partitioning. 

The  dichotomy  5 > 7 or  J > 5 is  performed,  and  it  is  seen  that  the 
restriction  5 > 1 implies  4 > 1 and  2 > h Hence,  5 > 2 yields 
= 5 and  7 > 5 is  imposed  at  node  2. 

Nodes  4 and  5 are  now  created  by  the  dichotomy  2 > 2 1 > 2- 

At  node  4 we  have  the  constraints  2 > 5 and  2 > 2 in  addition  to  those 
previously  listed  at  node  2.  At  node  5,  the  additional  constraints 
2 >5,  7 >2  and  7 > 5 are  present. 

= (2,  4,  2,  Z,  5),  LB^  = 6 

and  UB.  = 7 

4 

At  node  5 

LB^  =6,  C = (1,  4,  2,  Z,  S) 

Interchanging  the  order  of  7 and  4,  = (4,2f2,Z,S)  and  UB^  « 7,  Still 

at  node  5,  it  is  seen  that  4 > 2 or  2 > 4 provide  upper  bounds  greater 

than  or  equal  to  UB  and  node  5 is  fathomed. 

Returning  to  the  only  live  node  (node  4) , the  dichotomy  4 > 2 or 

2 > 4 is  applied  and  two  more  nodes  created.  At  node  6 we  have 

UBg  = LBg  » 7 and  ^ = (2^4,2 jZ^S).  Node  6 is  fathomed. 

• At  node  7,  2 > 4 implies  2 > S and  2 > Z.  UB^  - 7 and  LB^  = 6, 

with  (2^2,4,Z,S>).  By  attempting  further  dichotomies  it  is  shown 

that  the  restrictions  Z > 5 and  2 > 4 are  forced.  The  latter  restriction 
2 Z 

yields  I ^ =2  and  LB^  = 7.  There  are  no  longer  any  live  nodes  on  the 


tree  and  the  algorithm  terminates. 
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Alternate  optimal  ranking  are  given  by  {2jl,4,2,S) , 
and  {2^4,1^3,S)  with  d*  = 7. 

Aa  la  the  case  with  every  branch  and  bound  algorithm  there  are 
■any  ways  that  It  can  be  Implemented.  Refinements  In  the  algorithm 
presented  here,  along  with  a thorough  computational  study  will  be  the 
adbject  of  future  research  by  the  authors. 

4.  General  Ranking  Struatures 

In  many  decision  making  situations  Involving  committee  ranking  and 
the  associated  problem  of  concensus  derivation,  a more  general 
frasievord  than  that  posed  by  Kemeny  and  Snell  must  be  adopted.  We 
cite  a few  examples. 

Military  officers'  promotion  boards  are  assembled  for  the  purpose 
of  deciding  which  members  of  a group  of  candidates  (officers)  should  be 
elevated  to  the  next  highest  rank.  Each  senior  officer  on  the  committee 
oust  assesa  each  candidate  In  relation  to  a number  of  attributes,  and 
Bust  baae  the  assessment  on  Information  contained  In  performance 
evaluation  reports  as  well  as  any  additional  information  the  senior 
officer  In  question  might  possess.  Any  given  board  member  may  be  capable 
of  ranking  only  a proper  auhaet  of  the  candidates  - not  necessarily 
being  able  to  rank  all  of  them  in  an  order  of  preference.  One 
eomalttee  member  may  provide  more  information  (or  be  of  a higher  rank) 
than  another  member,  and,  thus,  should  be  weighted  differently  in  terms 
of  his  or  her  contribution. 

The  assessment  of  proposed  and  D projects  by  grants  committees 
Is  an  area  that  promises  to  be  one  in  which  the  concept  of  priority 
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ranking  and  concensus  will  assume  a major  role.  Since  the  committee 
members  come  from  a variety  of  disciplines  we  again  are  confronted  with 
the  possibility  of  having  to  deal  with  partial  rankings  and  weights. 

Federal  spending  in  defence  construction  has  become  an  Issue  of 

Increasing  importance  In  recent  times.  See  Brightwell  et.  al.  [2].  The 

% 

problem  Is  a multiphase  one  In  which  funds  must  be  dispensed  among 
various  major  military  bases,  then  across  numerous  sections  on  each 
base,  and  finally  across  a set  of  proposed  projects  within  each  section. 

A general  ranking  framework  allowing  for  such  things  as  partial  ranks 
and  weights  Is  required  to  be  able  to  deal  with  problems  of  this  nature. 

To  see  how  one  can  deal  with  partial  ranking  and  weighting  we 
Investigate  the  original  model  due  to  Kemeny  and  Snell  [5],  as  well  as  the 
model  of  the  previous  sections  and  see  how  the  consensus  concept  is  approached. 

Weighted  Reoikinga 

First  let  us  examine  the  effect  of  associating  weights  to  committee 
members.  With  reference  to  the  1,^  norm,  Kemeny  and  Snell's  definition  becomes 

M(B)  = \ w^d(A  ,B)  ^ minimuiv  I I ^ w 

i^l  B 1*1  i*l  j*2 

0 ^ 
vrlth  w representing  the  relative  Influence  of  member  i.  and  B the 

median  ranking.  In  [4]  we  define  i to  be  an  "eligible  immediate 

predecessor”  of  j If  In  any  ranking  3 In  which  i immediately  preceeda  j, 

no  improvement  in  d(A  ,B)  is  obtained  by  interchanging  i and  j or 
1=1 

by  tying  them.  An  "eligible  Immediate  successor"  and  "tie"  are  defined 
analogously.  For  the  general  case  (4.1)  analogous  definitions  are 


(4.1) 


obvious. 
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Let  m.  . denote  the  total  member  weight  in  favor  of 
IJ 

objects  i and  j,  and  r.  . the  total  weight  ranking  i and 

^<7 

natural  (reverse)  order.  That  is 


not  tying 
j in  the  non- 


r Jl 

m.  . = } w \a. 


(4.2a) 


and 


r J 

r.  . = ) u 0.  . where  6 . . ;=  ■< 

tj  ij  t.7  ) 


if  a^.  = -1 
^3 


(4.2b) 


\^0  otherwise. 

Q Theorem  4.1:  For  any  two  objects  i and  j (i  < j)  i is  an  eligible 


m 


immediate  predecessor  of  j if  r.  . 5 m.  . - ( ^ w*')/2^ 

13 


m 


an  eligible  immediate  successor  of  j if  r..  ^ f J w^)/2. 


T-3 


1=1 


^9  ^9 

and  is  eligible  to  tie  with  j if  m.  . - ( J,  w < r.  . < ( w^)/2. 

lui  i^i 

The  proof  of  this  theorem  follows  in  a straightforward  manner  from  that 
□ given  in  [4]  for  the  special  case  (1.1),  and  is  therefore  omitted. 


Defining  m.  . and  r.  . as  per  (4.2a)  and  (4.2b)  respectively,  and  utillting 
tj 

theorem  4.1,  we  can  apply  the  algorithm  of  [4]  in  the  usual  manner  to 

A 

derive  the  median  B aa  defined  In  (4*1). 

Turning  to  the  norm  problem  we  note  that  the  solution  procedure 
la  based  on  the  distance  between  pairs  of  committee  members  rather  than 
on  the  distance  between  each  committee  member  and  the  unknown  median, 
as  in  the  case  of  the  norm.  Reconsidering  (3.1),  for  example,  the 
lower  bound  is  defined  thus  since  in  the  case  of  equally  weighted 
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meobers  the  optimal  position  relative  to  any  pair  is  the  point 
Bildway  between  that  pair.  With  a general  set  of  weights 

•••>  the  optimal  position  is  at  distances  u^d^^/(w^+w^) 
and  from  members  k and  2.  respectively.  (3.1)  then 

becomes 


LB 


<max  . 

k,l 


(3.2)  becomes 


UB 


max  w^d(V,A^) , 
I 


(3. A)  would  need-to  be  redefined  accordingly. 


Partial  Ranking:  Single  Attribute 

The  definition  as  proposed  by  Kemeny  and  Snell  covers  only  special 
cases  to  the  extent  that  it  is  assumed  that  each  member  supplies  an 
"all  inclusive"  (a.l.)  ranking  of  the  objects,  that  is,  a preference 
ordering  of  all  n objects.  In  many  instances  an  individual  committee 
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aember  may  be  capable  of  supplying  a preference  ranking  corresponding  to 
only  a subset  of  the  objects.  Thus,  let  us  assume  that  each  member  5. 
supplies  a ranking  of  all  candidates  or  objects  in  a subset 
S c {2j  2,  n}.  We  consider  first  the  case  in  which  individuals 

are  ranked  on  the  basis  of  a single  attribute.  In  this  instance  if 
t »>  J > k then  automatically  i > k by  this  member,  and  we  get  no 
conflicts.  This,  we  shall  see,  is  not  the  case  in  the  multiple  attribute 
problem. 

^0  Ji  ^0 

It  Is  noted  that  in  case  S n 5 = 4)  for  all  Z / S can  be 

ranked  as  a set  of  objects  on  its  own.  As  far  as  the  existing  committee 

J'O 

is  concerned,  then,  no  object  in  5 can  be  directly  compared  to  any 

Ig 

object  in  S , the  compliment  of  5 . In  the  R and  D example,  S 

alight  represent  all  projects  in  the  humanities  category  with  S 
denoting  all  other  projects.  If  no  comparison  can  be  drawn  between 
those  elements  Inside  5 and  those  outside,  a ranking  for  each  of 
S and  its  compliment  would  need  to  be  supplied,  and  then  the  R and 
D budget  split  up  between  these  two  categories  by  means  of  some  other 
method. 

We  assume,  therefore,  that  for  each  member  there  exists  a 
member  *uch  that 


£ £ 

J.. 

S n 5 ^ 4). 


(4.3) 


In  this  case  each  object  will  be  comparable  with  every  other  object. 

£ £ 

The  ranking  A supplied  by  member  Z includes  the  elements  of  5 only. 

With  reference  to  the  median,  let  us  define  a matrix  representation 

of  by  (a\  J where 
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Z 

a.  . = 


if  i is  preferred  to  j 

-1  if  j is  preferred  to  i (4.4) 

0 if  either  i a^'d  j are  tied  or  are  not  compared. 


In  ordei  to  determine  a median  ranking  B,  which  will  be  that 

ranking  satisfying  (4.1),  we  need  to  derive  conditions  under  which 

an  object  i is  an  eligible  predecessor,  successor  or  tie  of  another 

object  J.  We  adopt  the  convention  that  the  final  decision  as  to  the 

preference  ordering  of  any  pair  (i,j)  must  be  a function  only  of  the 

orderings  provided  by  those  members  who  compared  i and  j.  A member 

who  does  not  commit  himself  to  comparing  i and  j cannot  influence 

their  ordering  in  B.  Let  S.  . denote  those  committee  members  I who 

I 

compared  i and  j when  their  rankings  A were  constructed,  r.  . and 

'L'O 

m.  . are  defined  as  in  (4.2a)  and  (4.2b).  We  state  without  proof  the 
following: 


□ Theorem  4.2:  For  any  two  objects  i and  j (i  < j) , i is  an  eligible 

• r Z 

immediate  predecessor  of  ^ if  r ..  i m ) w ) /2 

VO  to  ^ 


IcS.  . 
VO 


_ ^ 

an  eligible  immediate  successor  of  j if  r. . 2 ( ) w )/2 


VO 


£c5.  . 
VO 


• r Z 

and  is  eligible  to  tie  with  o'  vf  m } u )/2 

ZcS.. 

VO 

. V Z 

< <(  I V )/2. 

£e5.. 

VO 

Theorem  4.2  used  in  connection  with  the  branch  and  bound  method  of 
(4)  will  lead  to  an  a.i.  median  ranking  B as  a result  of  assumption  (2.3), 


•4 
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In  reference  to  determining  the  min  max  (H*)  ranking, distances  are 
computed  as  before  allowing  of  course  for  the  modification  given  in  (4.4). 
Lower  and  upper  bounds  are  computed  as  indicated  in  the  previous  subsection. 
The  sets  S ■ . play  no  part  in  developing  the  min  max  ranking. 

Multiple  Attributes 

, In  many  instances  candidates  are  assessed  on  the  basis  of  a set 
of  R attributes.  For  example,  in  the  construction  projects  case  attention 
must  be  paid  to  safety  and  security  implications,  impact  on  economy 
of  resources,  long  run  effect  on  operations,  and  duration  over  which 
the  benefit  of  the  project  will  be  realized. 

For  each  member  £ let  S denote  that  subset  of  [l,  2,  ...,  m} 

of  objects  on  which  member  £ can  make  a decision  regarding  a preference 

ILp 

ranking  according  to  attribute  r.  Let  (a..)  represent  the  matrix 
associated  with  the  ranking  of  S . For  one  reason  or  another  one 
attribute  may  be  deemed  more  Important  or  less  important  than  some 
other  attribute.  In  the  assessment  of  defence  construction  project 
proposals,  projects  classified  as  pertaining  mostly  to  security  and 
safety,  for  example,  are  considered  to  be  of  higher  priority  then  those 
categorized  as  general  maintenance  projects.  The  assignment  of  attribute 
weights  is  generally  a subjective  task.  In  addition,  these  weights  ban 
vary  from  year  to  year  particularly  In  the  construction  projects  example. 
Specifically  let  v be  a weight  expressing  the  relative  Importance  of 

attribute  r.  to  the  other  attributes.  In  determining  the  median,  for  example, 

^ £rn  £ r ^ 

we  then  weight  each  matrix  (a-  - ) by  the  factor  ^ y^.  The 

r-J 

BKdian  B must  be  defined  by 


M(B)  = minirr,um  Y 1 1.  1 \a  ~ 

B I r i Q r 


(2.5) 


■4 
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Weights  as  Functions  of  Infor’^.aticK  Added 

The  problem  of  assigning  weights  to  committee  members  is  an 
extremely  unsatisfying  issue  to  deal  with.  In  almost  any  problem 
involving  group  decision  making  there  is  always  the  question  as  to 

whether  one  member's  contribution  to  the  deliberations  is  of  more  value 

\ 

than  that  of  another  member.  In  the  priority  ranking  problem  described 
above,  each  member  utilizes  information  available  to  him  to  rank  objects 
(candidates,  projects,  etc.)  on  the  basis  of  various  attributes  possessed 
by  those  objects.  The  value  of  the  information  can  be  judged  in  various 
ways.  Some  of  these  are:  1)  the  number  of  years  of  experience  the  member 

has  had  on  similar  committees;  2)  the  rank  or  professional  status  of  the 
member;  3)  the  personal  experience  of  the  member  in  the  trade  involved. 

(A  mathematician,  in  assessing  a research  proposal,  could  call  upon  his 
own  experience  as  a researcher  in  the  technical  area  relating  to  the 
proposal) ; 4)  number  of  years  a member  has  been  personally  associated  or 

Involved  with  the  project  or  candidate  in  question.  (The  qualifications 
of  a candidate  being  considered  for  promotion  can  be  better  assessed  by 
an  officer  who  personally  supervised  that  candidate  for  some  length  of  tim.e 
than  by  an  officer  who  has  had  no  personal  connection  with  that  Candidate.) 

It  is  clear  from  the  preceding  paragraph  that  numerous  factors  must 
be  brought  into  focus  in  assigning  weights  to  Che  decisions  of  various 
committee  members.  Factors  other  than  those  mentioned  in  (1),  (2),  (3) 
and  (4)  would  be  those  associated  with  the  special  problem  being  considered 
at  the  time.  Every  ranking  problem  is  >.  liaracter ized  by  special  considerations 
.and  a need  for  a vast  amount  of  subjective  judgement.  Consequently,  it 
appears  that  the  only  general  statement  wliich  can  be  made  concerning  the 
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determination  of  weights,  is  that  weights  assigned  to  committee  members 
should  be  a function  of  the  information  contributed  by  those  members  when 
delegated  to  rank  a set  of  objects.  There  are,  of  course,  as  many  defini- 
tions of  information  as  there  are  problems  requiring  the  input  of  the  said 
Information  by  decision  makers.  Generally,  the  information  contributed 
by  member  I on  object  i relative  to  attribute  r can  be  defined  as 


7^  = 


f(x^,  x^,  Xp)  for  each  £ for  which  i e S 


Ir 


G if  i / S.  . 

Ir 


(4.6) 


The  parameters  x^,  x^,  x^  ..•>  x^  might  represent  quantitative  measures 
of  (1)  to  (4)  in  the  preceding  paragraph,  in  addition  to  any  other  factors 
specific  to  the  problem  in  question,  f may  be  simply  an  average  of  the 
values  represented  by  Xj,  •••  Xp.  f can,  however,  be  a more  formal 

measure  of  overall  contribution  of  the  member.  This  decision  would  need 
to  be  tailored  to  the  particular  problem  under  investigation. 

Given  definition  (4.6),  the  weight  assigned  to  member  £^  for  his 
Inputs  regarding  the  attribute  of  object  i can  be  defined  as 


(4.7) 


The  definition  of  the  median  as  given  in  (2.5)  Illustrates  that  it  is 
the  pairwise  comparison  of  objects  which  must  be  weighted,  and  not  individual 
objects.  A reasonable  weighting  factor  on  the  pair  (that  is  on  the 

term  la..  - i..|)  Is,  therefore. 
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u. 


y 


ij 


y y ^0^  y 

fu.  + 13.  )/2  if  both  w.  > 0 and  w.  > 0 

1 J ^ J 


0 otherwise. 


(4.8) 


Thus,  in  determining  a median  preference  ranking  of  the  objects 
in  {1,  2,  ...,  n)  the  relative  ordering  of  each  pair  (i,j)  is  a function 
of  the  decisions  of  those  members  who  compare  i and  j,  and  only  those 
members.  The  weight  assigned  to  a member  who  ranked  i and  j on  the  basis 
of  some  attribute  is  the  average  of  the  ratios  of  his  contributed  informa- 
tion to  the  total  information  supplied  by  all  members  who  ranked  i and  j 
relative  to  that  attribute.  (4.5)  then  becomes 


M(B)  = miniman  HH  v^/lv^)\a^^.  - b..\.  (4.9) 

The  purpose  of  this  subsection  has  been  to  outline  a methodology  for 
determining  weights  to  be  assigned  to  committee  members'  decisions.  The 
concept  of  information  is  an  intuitively  natural  one  to  explore  in  this 
regard.  The  difficulty  arises  from  trying  to  quantify  what  we  mean  by 
information.  In  addition,  there  is  the  related  problem  of  removing  bias 
from  committee  decisions.  In  a recent  paper  by  Warner  D.0]  a methodology 
is  given  for  extracting  information  from  advocates  through  the  preparation 
of  pro  and  con  briefs  on  a topic  of  controversy.  The  method  is  not 
fmmediately  applicable  to  the  preference  ranking  problem,  although  it 
does  give  some  promise  of  providing  a systematic  unbiased  means  of 
assigning  weights.  The  Investigation  of  such  a method  in  connection 
with  the  ranking  problem  may  be  the  topic  cf  later  research. 
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